Recurrent Neural Networks

Back to Home

01. Intro to RNNs
02. RNN vs LSTM
03. Basics of LSTM
04. Architecture of LSTM
05. The Learn Gate
06. The Forget Gate
07. The Remember Gate
08. The Use Gate
09. Putting it All Together
10. Other architectures
11. Implementing RNNs
12. Time-Series Prediction
13. Training & Memory
14. Character-wise RNNs
15. Sequence Batching
16. Notebook: Character-Level RNN
17. Implementing a Char-RNN
18. Batching Data, Solution
19. Defining the Model
20. Char-RNN, Solution
21. Making Predictions

Back to Home

07. The Remember Gate

Remember Gate

The output of the Remember Gate is:

LTM_{t-1}f_t+N_ti_t

Equation 3

( N_t, i_t and f_t are calculated in equations 1 and 2 )

Learn Udacity: click here to learn more :)